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Abstract 

The evolution of leadership in migratory populations depends not only on costs 
and benefits of leadership investments but also on the opportunities for indi- 
viduals to rely on cues from others through social interactions. We derive an 
analytically tractable adaptive dynamic network model of collective migration 
with fast timescale migration dynamics and slow timescale adaptive dynamics 
of individual leadership investment and social interaction. For large popula- 
tions, our analysis of bifurcations with respect to investment cost explains the 
observed hysteretic effect associated with recovery of migration in fragmented 
environments. Further, we show a minimum connectivity threshold above which 
there is evolutionary branching into leader and follower populations. For small 
populations, we show how the topology of the underlying social interaction net- 
work influences the emergence and location of leaders in the adaptive system. 
Our model and analysis can describe other adaptive network dynamics involving 
collective tracking or collective learning of a noisy, unknown signal, and likewise 
can inform the design of robotic networks where agents use decentralized strate- 
gies that balance direct environmental measurements with agent interactions. 

Keywords: Evolutionary dynamics. Adaptive networks. Collective migration. 
Leadership, Social networks 



1. Introduction 

A great variety of species including birds, fish, invertebrates and mammals 
engage in collective migration |2] |3j • The migratory process is often an 
adaptive response to conditions such as competition for resources in a dynamic 
environment, seasonal variability, and selection of new habitats for breeding 
[D El m |7] . On the one hand, animals perform migratory tasks by leveraging en- 
vironmental cues such as nutrient and thermal gradients, magnetic fields, odor 
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cues, or visual markers [HI [H [TO]. Measuring these stochastic environmental 
signals is complicated and requires the investment of time and energy, as well 
as the development of necessary physiological and sensory machinery such as 
vision in insects and vertebrates [2] and chemical signaling in bacteria [Hj. On 
the other hand, animals can perform migrating tasks by leveraging social cues 
from neighbors (nearby conspecifics) [l] [6[ [7] . By imitating invested neighbors 
(or neighbors of invested neighbors, etc.) using consensus processes such as co- 
hesion and alignment, some animals in a group can migrate well without paying 
the costs associated with directly measuring and processing the environmental 
signal. 

The interplay between costly information acquisition from the environment 
and relatively less expensive social interactions with the group raises two impor- 
tant questions regarding leadership and social interactions in migratory popu- 
lations. Here, leadership means the influence of individuals who are informed 
about the environmental signal, e.g., by investing time and energy in taking a 
measurement. Although these informed individuals are referred to as "leaders" 
and the remaining uninformed individuals as "followers" , it is not assumed that 
leaders can be identified or can signal their information to others. 

The first important question relates to the migratory performance of large 
groups in the presence of a limited number of leaders, i.e., can a subset of in- 
formed individuals effectively lead a large group? Couzin et al. [12] address 
this question using individual-based simulations (involving social forces of at- 
traction, repulsion and alignment among individuals) and demonstrate that in 
a group of socially interacting individuals, a small fraction of informed leaders 
can effectively determine the direction of travel of a large group of uninformed 
followers. 

The second important question relates to the evolution of leadership in collec- 
tive migration, i.e., under what conditions is the coexistence of invested leaders 
and social followers stable in an evolutionarily sense? This question is espe- 
cially relevant when the cost of investing in signal acquisition is sufficiently 
high; followers can leverage the investments made by leaders using social in- 
teractions without having to pay the investment costs themselves, but not all 
individuals can be followers if the group is to migrate successfully. Guttal and 
Couzin [5^ address this question (also see related commentary |13j) using evolu- 
tionary simulations and an individual-based model similar to that used in |12] : 
they show that the specialization of groups into coexisting leaders and followers 
(also known as branching) is a stable evolutionary outcome. 

Motivated by these questions and results, we develop an analytically tractable 
model of collective migration with which we can rigorously study the adaptive 
network dynamics associated with the evolution of collective migration and the 
emergence of leadership when leadership is costly and social interaction is rela- 
tively cheap. We investigate the inffuence on group- level outcomes of the (evolv- 
ing) network topology, i.e., who is sensing and responding to whom within the 
group, as a function of the cost of investing in the environmental signal. Our 
model can be generalized to a broader set of adaptive network dynamics associ- 
ated with a collective task, such as collective tracking or collective learning of a 
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noisy, unknown signal [TH [15] , carried out by agents with decentralized strate- 
gies that balance direct environmental measurements with social interactions. 

Torney et al. [6] derive a mean-field approximation to the evolutionary model 
studied in and using tools from evolutionary adaptive dynamics [16l[T7] prove 
conditions for the branching of a migrating population into leader and follower 
groups. The mean-field approach effectively prescribes an all-to-all social in- 
teraction topology between the individuals in order to reduce dimensionality, 
critical to the analysis in [6]. However, the approach ignores the potentially 
important role of limited social interactions; indeed, it has been shown that 
network topology plays a critical role in determining outcomes in collective dy- 
namics [m [151 UHl mi Uni m] • our model derives directly from the model of [6] 
with a key generalization to the case of limited interaction networks and a mod- 
ification that allows individual fitnesses to be computed from a linear matrix 
equation as a function of the network topology encoded by a directed graph. 

In our model each agent i has a scalar strategy ki{t) G [0,1] at time t 
which defines how much it invests in the environmental signal; ki = means 
no investment and ki = 1 means full investment. The strategy also determines 
how much it attends to social interaction: a higher ki implies a lower attention 
to measurements of neighbors, equivalently, the associated edges of the network 
graph are scaled by (1 — /c^)^. The network dynamics have two timescales. In 
the fast timescale the strategies ki are fixed, such that the stochastic migration 
dynamics and the fitnesses depend on a fixed interconnection topology. In the 
slow timescale the strategies ki change according to evolutionary (or adaptive) 
dynamics and with them the investments and graph edge weights. 

We present three main results that leverage the extension of the migration 
model of ^ to directed, limited social interaction topologies and the corre- 
sponding matrix equation for fitnesses (which replaces extensive Monte-Carlo 
simulations as used in [£l 0). Our first main result is a complete bifurcation 
analysis of the two-timescale dynamics as a function of investment cost in the 
case of a large population with an underlying network topology that is all-to- 
all; our results explain previous observations that are initial condition dependent 
and demonstrate the hysteretic effect associated with losing and then recovering 
migration ability as described in [5l [22] . Our second main result addresses the 
two-timescale dynamics in the case of a large population with an underlying 
network topology that is limited; we find a relatively small threshold in connec- 
tivity above which there is evolutionary branching and emergence of leaders. 

Our third main result addresses the case of a small population in which the 
slow evolutionary dynamics of strategies /c^, based on replication and mutation, 
are replaced with individual greedy adaptive dynamics. We show the critical 
role that the structure of the underlying network topology plays in determining 
the location of leaders in the adaptive network and in infiuencing bifurcations in 
the dynamics as a function of increasing cost. This analysis is motivated in part 
by an interest in leveraging the mechanisms of evolved natural collectives in the 
design of decentralized protocols for collective motion and decision-making in 
robotic groups [181 [23] . 
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The paper is outlined as follow^ In Section [2] we present our evolutionary 
migration model. We derive analytical results for fitnesses on the fast timescale 
in Section [3] We study the slow timescale dynamics in the all-to-all limit in 
Section |4] and for limited interconnections in Section [5] We focus on adaptive 
dynamic nodes in small networks in Section [6] and conclude in Section [71 

2. Model description 

Our model is derived from the mean-field migration model in [6 with two key 
modifications; we explicitly account for a limited social interaction graph topol- 
ogy in the dynamics and we introduce a slightly modified social noise model to 
allow for analytical fitness computations as a function of graph topology and in- 
dividual investments. In the remainder of the paper we will refer to individuals, 
agents and nodes interchangeably, and likewise population and network. 

Consider a set of N agents indexed by i G {1, • ' • 7^}- Let Xi{t) G M be 
the direction of migration of agent i at time t, and let /i G M be the "true" 
desirable direction of migration. Accurate tracking of the direction ja over time 
may correspond to benefits such as improvement in environmental conditions 
for foraging, predator evasion, early access to breeding grounds, etc. Following 
[6], the stochastic dynamics of each agent are given by 

dxi = kidxDi + (1 - h)dxsi, (1) 

where dxoi and dxsi are the driven tracking and social consensus stochastic 
processes, respectively. The adaptive strategy ki G [0, 1] tunes the level of in- 
vestment made by agent i in the driven and social processes. When /c^ = 1, 
agent i is fully invested in the tracking process and ignores social cues, while 
when ki = agent i exclusively leverages social cues without tracking the envi- 
ronmental signal. 

The driven process dxjji is modeled as an Ornstein-Uhlenbeck stochastic 
process [25l [26] of the form 

dxDi = -kDi{xi - ii)dt + (jDdWDi- (2) 

The parameter k^i >0 corresponds to the gain associated with tracking, cr|) > 
is the noise intensity associated with measuring the environmental signal /i, and 
dWm represents the standard Wiener increment. For koi > 0, the process ([2| 
has a steady-state mean and variance given by 

2 

lim E [x,] = ^i, lim E [{x, - ^if] = (3) 

Higher values of tracking gain kni result in lower steady-state variance in mi- 
gration direction x^, which corresponds to improved tracking. 



See |24j for related text and figures. 
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The social consensus process dxsi is modeled using basic tools from graph 
theory [27l [28l [29]. Individuals are modeled as nodes on a directed social 
interconnection graph with underlying structure defined by adjacency matrix 
A = [aij] G R^^^. A directed edge in the graph from individual i to individual 
j is read as can sense j". Let Afi denote the set of neighbors of individual 
i (i.e., the set of agents that individual i can sense), and let \\JVi\\ denote the 
cardinality of this set (number of neighbors that individual i can sense). The 
adjacency matrix A is given by 




if j e Mi 
otherwise. 



(4) 



where ||M||+ is the pseudoinverse oi\\Mi\\ (||M||+ = when \\Mi\\ =0, 11^11+ = 
l/||A/i|| otherwise). The Laplacian matrix of the graph corresponding to A is 
given by L = diag(Al) — A, where 1 is a vector of ones of appropriate dimension. 

The social consensus process dxsi depends on the underlying social interac- 
tion graph Laplacian L, the gain associated with the social process ksi > 0, and 
the noise associated with measuring the social signal asi > as follows: 

dxsi = -ksiLixdt + dsidWsi, (5) 

where dWsi is the standard Wiener increment, Li denotes the i^^ row of L 
and X is the vector of the Xi. In the social consensus process the graph that 
represents the social interactions is the underlying graph modified such that all 
edges from agent i are weighted by gain ksi, i = 1,...,A^. Then ksiLiX = 

Following the setup in [6 , we make a simplification to reduce the parameter 
space to one dimension by assuming that the gains are proportional to the 
relative investments in each process, i.e., k^i = ki and ksi = l — ki. Substituting 
into ([2| and ([5| and then into ([T]) we have 

dxi = kidxDi + (1 - ki)dxsi 

I (6) 

= -kl{xi - ii)dt - (1 - kifLiXdt + y A:f cr|) + (1 - kifcrl^ dWi, 

where dWi is the standard Wiener increment. Define the coordinate transfor- 
mation Xi as 

Xi = — and correspondingly x = — — (7) 

Substituting ([7|) in ([6| and using L^l = we have the normalized dynamics 



dxi = -k^Xidt - (1 - kifLixdt + W A:f + (1 - kif^ dWi. (8) 

V 

The social noise term crsi reflects the difficulty that agents have in extract- 
ing social cues from interactions with neighbors. In [6 , it is assumed that this 
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difficulty (magnitude of asi) decreases as the ordering or coherence of the pop- 
ulation increases. Here we take a slightly different local (and graph dependent) 
approach and relate the social noise term for an agent to the average investment 
of the neighbors of that agent as 

2 

^=^3\l-kr^bhd,^). (9) 

where 

knbhd,i ^ h 

and P is a social noise scaling parameter. In vector form, knbhd 
(/ci, . . . , /cat)"^. In this model agents that interact socially with neighbors having 
a high level of investment, have a correspondingly lower social noise term, and 
are hence better able to extract social cues from their neighbors. 

The stochastic system ([8| can be written compactly in matrix form as 

dx = -(Ki + K2L)x dt + SdW, (10) 
where the diagonal matrices i^Ti, K2 and S are given by Ki = diag(/c|), K2 = 
diag ((1 - k,)^) and S = diag (V^f + /^^(l - fc,)'(l - ^n6/^d,0) • 

As discussed in O [6] , the long-term migratory performance of agent i with 
dynamics @ can be computed as exp {^) , where ^L, = lim E - 



is the steady-state variance of Xi. For an agent i that moves at a constant mean 
speed in the direction x^, this performance measure corresponds to the expected 
migration speed of the agent in the desired direction ja. The fitness or utility of 
agent i is defined in [S] [6] as 

F, = exp (^^^ j exp {-ckf) , (11) 

where the second exponential models the cost associated with investment in 
tracking, and c > is a scaling cost parameter. The form of cost function is 
chosen for analytical tractability. Simulations in [6[ [5] show that reasonable 



variations of the fitness function (11) yield qualitatively comparable results. 

The saturating form of the performance function exp ^— as a function 
of investment can be interpreted as modeling the diminishing returns of increas- 
ing investment. Further, the quadratic form of the cost ckf implies that higher 
investments in the driven process are increasingly costly. The optimal strategy 



for solitary migrating individuals can be found by maximizing (11) with respect 



to koi after substituting for ,^ = from ([3|. This results in 

kD,opt = (12) 



While disconnected individuals may adopt the optimal strategy (12), the pres 



ence of social interactions between individuals leads to very different strategies. 
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3. Fast timescale analysis 



In this section we study the stochastic migration dynamics (10) and derive 
analytical tools to compute migratory performance as a function of the underly- 
ing network graph Laplacian L and agent investments ki. These tools are used 
to compute fast timescale fitness (utility) in slow evolutionary (adaptive) dy- 
namics in the sections that follow. This includes Section |4j where the population 
is large and the underlying network topology is all-to-all, but most particularly 
Section [5j where the population is large and the underlying network topology 
is limited, and Section |6] where the population is small. 

It is straightforward to show that if /c^ > for all i then the population 
can migrate for any network topology; likewise, if the population can migrate 
then it is necessary that /c^ > for at least one agent i [24 . If the network 
has a spanning tree and /c^ > for the root node of the spanning tree then the 
population can migrate [30 . In Theorem [l] we prove conditions on L and k that 
are necessary and sufficient for asymptotic stability of the zero equilibrium of 



the dynamics (10) without noise: 

^ = Mx, where M = -{Ki + K2L). (13) 



The asymptotic stability of (13) corresponds to the population developing the 



ability to collectively migrate since ^ => x ^ jil. In Theorem|2]we prove 



that asymptotic stability of (13) is necessary and sufficient for there to exist 



a steady-state probability distribution of x for the stochastic dynamics (10), 
and we show that the steady-state covariance matrix, and thus the individual 
fitnesses, can be computed from a Lyapunov equation that depends on L and 



k. The dynamics (13) are asymptotically stable if and only if M is Hurwitz, 
i.e., all eigenvalues of M have strictly negative real part. 

The proof of Theorem [l] requires the following lemma from [31 (see also 
[271 [32]). We first make the following definition. 

Definition 1. A directed graph has a directed spanning tree if there exists at 
least one node k on the graph such that a directed path exists from every other 
node on the graph to node k. Node k is known as a root node of the graph. 

Lemma 1. For a general Laplacian matrix L = [lij] G R^^^ given by Uj < 

N 

for i ^ j and ^ij = for all i G {1, • • • ^N}, the following conditions are 
equivalent: 

(i) L has a simple zero eigenvalue and all of the other eigenvalues have posi- 
tive real parts. 

(ii) The directed graph G{L) has a directed spanning tree, where G{L) is the 
graph with adjacency matrix A = [cLij], an = for all i, and ctij = —kj 
for all i ^ j. 

(iii) For z G , the dynamics z = —Lz converge asymptotically to al for 
some scalar a. 
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Proof. See Lemma 3.1 in [31], Theorem 2 in [2T, and Lemma 2 in [32] . 



□ 



For undirected connected graphs, every node is a root node. For general 
(connected or disconnected) directed graphs, one can define a root set that is 
accessible from every other node in the network, i.e., there is a directed path 
from every node to at least one node in the root set. Let 71{L) denote a minimal 
root set (set with smallest cardinality) of the graph Q{L) with Laplacian L. The 
set 71{L) is not necessarily unique as is illustrated in Figure [l] For example, for 
an undirected connected graph, Tl{L) = {i} for any node i. 




Figure 1: Illustrations of the root set 7^(L) and the conditions of Theorem[T] In each graph, the 
set of nodes labeled 1, • • • , and solid arrows correspond to the underlying social graph G(L). 
The complete set of nodes labeled 0, 1, • • • , and all the arrows correspond to the augmented 
graph Q{L), where node represents the external signal. All three augmented graphs shown 
have a spanning tree rooted at node 0, and hence satisfy the conditions of Theorem [l] (a) 
7^(L) = {i} , any i G {1, 2, 3, 4, 5}. (b) 7^(L) = {3}. (c) 7^(L) = {2, 3, 6} or {2, 3, 7}. 



Theorem 1. Matrix M from (13) is Hurwitz if and only if there exists a min- 
imal root set 71{L) such that kj > for all nodes j G Tl{L), where L is the 
Laplacian matrix of the underlying social graph with adjacency matrix Q . 

Proof Define the normalized external signal state xq = (equivalent to xq = ja) 
and the augmented state vector z = [xq x] . Consider the dynamics 



z = 



Xo 







Oatxi 


X 






-M 



Xo 
X 



= -Lz. 



(14) 



Then L satisfies the properties of general Laplacian matrices given in Lemma 
[l] Q{L) is the same as the graph Q{K2L) with the addition of the node (with 
state Xo) having incoming links with weights /c| from all nodes j = 1, • • • ,N 
(see Figure [l] for an illustration where links to node with kj > are shown as 
dashed arrows). 

Since node of G{L) has no outgoing links, following Definition [l] we have 
the following condition. 



Q{L) has a spanning tree 



7^(L) = {0}, 



(15) 



8 



We claim the following 



Q{L) has a spanning tree =^ 3 71{L) s.t. kj > for all j G 1Z{L). (16) 

We prove the statement above by contradiction. Assume that Q{L) has a span- 
ning tree and for each root set 71{L)^ there exists a node j such that kj = 0. 
Since Q{L) has a spanning tree, 71{L) = {0}, which means that there is a di- 
rected path from every node to node 0. Now consider any root set 1Z{L). Since 
kj = 0, node j in 1Z{L) can only reach node by a path to a node m ^ Tl{L)^ 
for which km > 0. However, if such a path exists, then the set 1Z{L) where node 
j is replaced with node m is another root set. By assumption we must have 
km = 0. Thus there exists no directed path from node j to node 0. Hence Q{L) 
does not have a spanning tree and we have proved the claim. 

Consider any root set 71{L) and assume that kj > for all j G 1Z{L). Then 
all nodes j G ^^{L) are connected to node of Q{L). For all nodes m ^ Tl{L)^ 
either km > and m has a direct link to node 0, or = in which case m has 
a link to at least one other node on a directed path to the root node 0, via an 
element of 1Z{L). Hence 

3 Tl{L) s.t. kj > for all j G Tl{L) =4> Q{L) has a spanning tree . (17) 



Combining (15), (16) and (17), we have that 

3 Tl{L) s.t. kj > for all j G Tl{L) <^=4> G{L) has a spanning tree 

^ nL) = {0} . (18) 

From Lemma |ll Git) has a spanning tree if and only if the dynamics il4i 
converge asymptotically to al for some scalar a. However in (14), the state 
= is invariant and hence a = 0. Thus, 

G{L) has a spanning tree M is Hurwitz. (19) 

Combining (p^sl) and (p^Ol) we have the desired result. □ 



Each of the graphs illustrated in Figure [T] satisfies the conditions of Theo- 
rem [l] since kj > for all j in at least one root set of 1Z{L) (dashed arrows). 
We now return to the noisy migration model given by the system of stochastic 



equations (10). In order to compute the fitness of an individual in a migratory 
collective as defined by (pTj ), a computation of the steady-state variance of the 
individual's dynamics aj^ /is necessary. This quantity in turn depends on the 
level of investment of each of the individuals in the network (represented by 
the vector k) and the topology of the underlying social interconnection graph 
Q{L). The variances are the diagonal elements of the steady-state covariance 



matrix S for the dynamics (10), which can be computed by solving the matrix 
Lyapunov equation defined in Theorem [2] (see also p!9^, T3 for related results on 
the consensus and drift-diffusion models respectively). 
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Theorem 2. For the stochastic dynamics (10) with social graph Q{L), suppose 
there exists an Tl{L) such that kj > for all j G 1Z{L). Then the system 
of stochastic differential equations (10) has steady-state mean lim E[x{t)] = 

and steady-state covariance matrix S = lim E \x{t)^x{t)] given by the solution 
to the Lyapunov equation: 

{Ki + K2L)^ + + K2Lf = SS^. (20) 



Proof The system ( |10| ) is a multivariate Ornstein-Uhlenbeck process with mean 
given by [26] 

E[x{t)] =exp{Mt)E[x{0)]. 
By Theorem jlj M is Hurwitz and hence ^lim E [x{t)] = 0. 
The covariance matrix of x is given by 

E[ix{t)-E[mmt)-E[m]f] 

t 

= exi){Mt)E [x{0)x{Of] ex.-p{Mt) + j exp(M(t - exp(M^(t - s))ds. 



Since M is Hurwitz, the steady- state covariance matrix is given by 

t 

T.= \im E \x(t)x{t)^] = lim / exp(M(t - s))SS^ eMM^(t - s))ds, 

t^oo '- t^oo J 



which as is shown in [26] is the solution to the Lyapunov equation: 

MS + SM^ + SS^ = 0. 

□ 

We leverage the results of Theorem |2] to study the role of network topology 
in the evolutionary dynamics of collective migration in Sections |4] |5j and [6| 
We note that the theorem proves useful even in Section [4] where the underlying 
network topology is all-to-all, because in the general case the different individual 
investment strategies provide different edge weights in the social graph, making 
for a directed network topology. 



4. All-to-all case 

4.1- Model specialized to the all-to-all case 

As a first step in analyzing the evolutionary dynamics of the social migration 
model ( [To] ) with fitness (11), we consider the limit of all-to-all interconnection 



= i 7^ j in (|4])) in a large population (labeled the resident 

population with subscript i?), with all individuals having a common level of 
investment kn > 0. This limit corresponds to the mean-field assumption used 
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in |6] . By the law of large numbers, the average direction of population migration 
in the limit of large N is the same as the desired migration direction fi after 
the decay of transients (i.e., in steady-state, lim Lx = x — jil). Substituting 

N^oo 

Lx = X in (10), the dynamics of an individual in the population are given by 



dxR = - [4 + (1 - knf] XR dt + \lkl + /32(1 - knf dW. (21) 



The corresponding steady-state variance of an individual's direction is given 



by 



2 _ kl + pHl-kn)' 



(1 - 



(22) 



with steady-state migration speed (performance) given by exp(— cr^^ ^/2). In 
Figure |2] we plot this steady-state migration speed as a function of investment 
ku for varying social noise term p. As defined in (|9|, the parameter P refiects 
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Figure 2: Steady-state migration speed as a function of resident population investment pa- 
rameter kji and noise parameter /3 for a large population with all-to-all interconnection. 



the strength of the noise from social interactions relative to the noise associated 
with the tracking process. In Figure [2] we see that the migration performance 
saturates at high levels of investment kR^ and remains low over greater kR 
ranges, for large /3. We use /3 > 2 in this work to model noisier social inter- 
actions relative to tracking (consistent with [6 ); this provides an incentive for 
individuals to invest in the tracking process. 

^.2. Evolutionary adaptive dynamics 

Now consider the evolution of strategies for such an all-to-all connected 
population. A key part of any evolutionary algorithm is the computation of 
fitness of individuals in the population as a function of strategy distribution, 
model parameters, environmental conditions, and other such features. In certain 
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cases (such as the ah-to-ah hmit here), fitness can be analyticahy computed, 
which allows for an explicit calculation of the outcomes of the evolutionary 
process using tools from adaptive dynamics [161 HZl [33] . Adaptive dynamics are 
well-suited for studying the evolution of a continuous one-dimensional trait in 
a population undergoing small mutations. 



with dynamics (21) is given by 



Using (22) and (11), the fitness of an individual in the resident population 



Fnikn) = exp 



2kf 



I) 



ck\ 



(23) 



Consider a small population of mutants with strategy ku interacting with each 
other and with all the residents. The mutants (owing to their small numbers) 
will experience the same social noise as the residents so their dynamics are 



dx 



M 



[kl, + (1 - kuf] XM dt + ^Jkl,^p^(l-kR)(l-kM? dW. (24) 



Correspondingly, the fitness of individuals in the mutant population is given by 

^f3\l-kR){l-kM)^ 



FuikR^ku) exp 



M 



2kM + 1) 



M 



(25) 



The relative fitness of the mutant strategy in the environment of the resident is 
known as the differential fitness and is given by 



S{kR, ku) = FM{kR, ku) - FRikR). 



(26) 



For a given resident strategy kR^ the values of ku that result in > 
correspond to the mutant strategies that when rare can invade the established 
resident population. Further, a study of the selection landscape S can help 
us predict conditions for an evolutionarily stable monomorphic population (all 
individuals having the same strategy) and conditions for evolutionary branching 
into subpopulations of leaders {ki ~ 1) and followers {ki ~ 0), as a function of 
the cost c associated with strategy investment. 

The evolutionary dynamics of the resident strategy kR are given by 



dkR 
dr 



■1 



dS 



dk 



M 



='1 gikR), 



(27) 



where gikR) is the selection gradient and 7 is a positive scalar constant. We 
note that the timescale r associated with (27) corresponds to slow evolutionary 



time and is different from the fast timescale t associated with the stochastic 
migrations dynamics ([To| and (21). For the differential fitness S defined in 
([26]), ([23]) and (25), singular strategies k^ corresponding to equilibria of (27) 



(defined as g{k^) = 0) are given by the solutions to the following equation 



(details in Appendix A): 



k^ [/3^(1 - k^) - 1] {k^ - 1) + Ack^{2kl - 2k^ + 1)^ 



0. 



(28) 
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A singular strategy is known as a Convergent Stable Strategy (CSS) if it 
is locally asymptotically stable for the dynamics (27), i.e., if 



dg 
dkn 



< 0. 



(29) 



A CSS strategy can be either locally evolutionary stable (local ESS) for the 
population, or it can be a branching point for the population. The condition 
for it to be a branching point is 



dkj^ 



> 0. 



(30) 



Appendix A ) 



For S defined in (26), the branching condition (30) evaluates to (details in 

V7 



< k^ < 



6 



0.3923. 



(31) 



The branching condition (31 ) is exactly the same as that obtained in [6 . Param- 
eters (3 and c of the dynamics that yield CSS singular strategies k^ G (^0, 
result in populations with distinct leader and follower groups via evolutionary 
branching. 

4-3. Results 

The bifurcation diagram in Figure [3] summarizes the singular strategy con- 
dition (28), CSS condition (l29|) and branching condition (IMl) to obtain four 



distinct sets of evolutionary outcomes (in ranges A, B, C and D) for our model 
for increasing cost parameter c (calculations in Appendix A): 



(A) Monomorphic population: For < c < 



there exists only one CSS 



strategy, and it is evolutionarily stable (since k^ > ^~g^ ), resulting in a 
monomorphic population with strategy k^. The other singular strategy 
corresponding to the fully social strategy /c* = is not convergent stable. 

(B) Two local CSS's that are each evolutionarily stable: For ^ 



- < c < Ci 

there exist two convergent stable strategies, one of which is the fully social 
strategy k^ = 0. Both singular strategies are locally evolutionarily stable. 



ci is defined implicitly as the solution to the equation 



(C) Branching: For ci < c < C2 the convergent stable interior {k 

singular strategy satisfies the branching condition (31) resulting in the 



= 0. 

M0,1)) 



population splitting into distinct leader and follower groups. 
(D) Collapse of Migration: For the high cost scenario c > C2, the only singular 
strategy that exists is the convergent stable fully social strategy /c* = 
and the population does not develop any migration ability. 
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Branch-^CoUapsc- 




Figure 3: Evolutionary singular stra tegi es fc* as a function of cost parameter c. The two 
sets of singular strategies defined by \28\ are plotted in blue. One set corresponds to fc* = 



and the other corresponds to the curve given by the equation c : 



(l-fc,)[/3^(l-fc.)-l] 
4(2fc2-2fc*+l)2 



Solid 



curves are CSS strategies, and dashed curves are unstable singular strategies. The regions 
marked (A)-(D) correspond to the descriptions in the text. Anal ytical derivatio ns for the cost 



parameters ^ . , ci and C2 that divide the regions are given in Appendix A 



These four cases constitute a comprehensive picture of the evolutionary dy- 



namics of the migration model (10) in the all-to-all limit, and encompass key 



features of the branching calculations in [6 and evolutionary simulations in [5 . 
The existence of two locally evolutionary stable attractors in case (B) above 
implies that the evolutionary dynamics can potentially yield two-strategy out- 
comes in the population without evolutionary branching (case (C)). 

A hysteretic effect associated with restoring population migration ability 
once destroyed is apparent in Figure [3| In particular, once migration ability in 
the population is lost for high cost parameter c > C2, the cost parameter needs 
to be reduced below the level (i.e., below Ci < C2) for migration ability 

to be regained. This compares to the simulations in [S] |22] where agent-based 
models are used to study the effect of habitat fragmentation on the evolution of 
migration (see also [7 ). In these simulations, the authors study the impacts of 
progressively more fragmented habitats on migratory outcomes, and show that 
once migration ability is lost for a threshold level of fragmentation, much greater 
habitat recovery is necessary to restore lost migration ability (a hysteretic effect). 
Higher levels of habitat fragmentation are comparable to higher cost c. 

In Figure [4] we show the pairwise invasibility plots (PIPs) [16l|T7l|33] of the 
differential fitness S{kji^kM) for increasing cost c to illustrate the four sets of 
outcomes described above. These plots show the sign of 5 as a function of the 
resident and mutant population strategies. Dark regions correspond to differ- 
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|3 = 3 c=2.6 P = 3 c=3.8 







Figure 4: Evolutionary dynamics for the migration model with all-to-all interconnection, noise 
parameter /S = 3, and with increasing cost parameter c from left to right: c = 1, 2.2, 2.6, 3.8. 
The top row shows the pairwise invasibility plots for kM vs. kji, each from to 1. Black regions 
correspond to differential fitness S{kji, > (mutants can invade) and white regions to 
S < 0. The red vertical lines pass through convergent stable interior strategies kji = k^. The 
middle row of plots are evolutionary simulations starting with a monomorphic population 
with strategy k = 0.5; hot colors correspond to high population density. The bottom row 
of plots are also evolutionary simulations, but having an initial population with a uniformly 
randomly distributed strategy k G [0, 1]. We use = 2000 individuals for these simulations. 
The threshold costs as defined in Figure [s] for (3 = 3 are ci = 2.48 and C2 = 2.77. 



ential fitness 6* > and allow mutant invasions; white regions correspond to 
< and prohibit mutant invasions. The population resides on the diagonal, 
and is monomorphic when a negative differential fitness is associated with the 
red vertical line through the singular strategy . The PIPs in Figure [4] show 
conditions for an initially monomorphic population for low values of cost param- 
eter c and population branching for intermediate values of c. For high values 
of c we see conditions that prevent individuals from developing any significant 
investment and therefore any significant migration ability. 

We confirm our predictions from the adaptive dynamics analysis by running 
evolutionary simulations in the case of a monomorphic initial condition and 
also a uniformly randomly distributed initial condition as shown in Figure [4] 
(bottom two rows) . These simulations comprise the roulette- wheel selection [34] 
and small mutation operations on each generation of a population of N = 2000 
individuals with all-to-all social graph, dynamics (10), and fitness (11). The 
fitnesses are computed for each generation using equation ( 20 ) of Theorem [2] 
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The columns in Figure |4] from left to right correspond to the cases (A)-(D) 
respectively. In case (A), both initial conditions result in a monomorphic evo- 
lutionary outcome. In case (B), the polymorphic solution for the evolutionary 
simulation with random initial conditions (Column 2, last Row) is a consequence 
of the stability of the = singular strategy, and not a consequence of branch- 
ing, as is the case in (C). Case (D) corresponds to the collapse of migration with 
all individuals having an insignificant level of investment. 

The analysis in this section shows the range of evolutionary outcomes for 
the migration model with all-to-all social interconnection. We are particularly 
motivated by conditions that result in the branching of the population into 
invested leaders and social followers. In the following section we study the 
role that limited social interconnection topology plays in the emergence of this 
evolutionary branching. 



5. Limited interconnections case 

While the all-to-all topology assumption of Section [4] allows for a detailed 
analysis of the evolutionary dynamics in a large population, it is unrealistic for 
most biological and decentralized artificial systems. In this section, we relax 



the all-to-all assumption and study the migration model (10) with underlying 
limited interconnection. 

The Lyapunov equation ( 20 ) in Theorem [5] allows us to compute (without 
simulation) the migratory performance (and correspondingly fitness ( pT] )) of 
individuals since the diagonal terms of the steady-state covariance matrix S are 
the individual steady-state variances ^. In this section, we use evolutionary 



simulations based on fast timescale fitness calculations from (20) to study the 
role that graph connectivity plays in the evolution of branching. 

We focus on three classes of social graph topologies of which one is ordered 
(ring lattice) and two are random (undirected and directed). In each class, 
a single parameter controls the level of connectivity of the graph. The three 
classes of graphs used are listed below: 

• Undirected Ring Lattice: A graph with N nodes, each connected to K 
nearest neighbors, K/2 on each side, for K even. An undirected edge exists 
between nodes i and j if and only if < min {|z — j\^ N — \i — j\} < K/2. 
The graph is connected for > 2. 

• Random Undirected (Erdos-Renyi) [35l [36]: Undirected graph with N 
nodes. Every edge in the graph exists randomly with a uniform probability 
p. The expected number of neighbors of a node is E[K] = Np for large 
A^. The graph is almost surely connected if p > \n{N)/N or equivalently 
E[K] > \n{N). 

• Random Directed [33 [38]: Directed graph with N nodes. Each node has a 
probability p of having a directed link to every other node in the network. 
The expected number of neighbors of a node is E[K] = Np for large N. 
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Figure 5: Effect of number of neighbors K on the evolutionary outcomes of the migration 
model. The left plot shows the equilibrium strategy distribution as a function of number of 
nearest neighbors for the ring lattice graph model with = 400 nodes and parameters /3 = 3 
and c = 2.6; bright colors correspond to higher population density. The two plots on the right 
labeled (a) and (b) are evolutionary simulations, the steady-state conditions in these plots 
correspond to the red dashed slices in the left plot. The two- strategy equilibrium exists only 
once the graph connectivity exceeds a threshold number of neighbors {K 15 for parameters 
chosen here). 



For each class of topologies, the parameters K and p allow us to explore 
a range of connectivities; for = p = 0, the social graphs are fully discon- 
nected and individuals must resort to solitary migration with a monomorphic 
optimal strategy ([l2|. For K ^ N — 1 (for the ring lattice) and p ^ 1 (for 
the random graphs), the social graph is fully connected, resulting in the leader 
and follower evolutionary equilibrium for certain parameter choices as discussed 
in Section [4j Between these two connectivity extremes, intuition suggests that 
an intermediate level of limited connectivity can provide adequate information 
flow in the network for followers to leverage the investments made by leaders, 
thereby resulting in the two distinct populations. In Figures |5] and [6] we confirm 
this intuition by showing that the transition from a monomorphic solution, to a 
branched evolutionary solution as a function of topology (parameterized by K 
and p) , occurs at an intermediate threshold level of connectivity. 

For the simulation in Figure [5] we use the ring lattice topology for the social 
graph with N = 400 individuals and choose a set of parameters for which the all- 
to-all social graph is known to have a two- strategy solution, /3 = 3 and c = 2.6 
(see Figure |4j column 3). For a range of values of the number of neighbors 
K = 2,4, ••• ,100, we compute the fitness of individuals using (20) and (11) 
and evolve the strategies of the populations to an evolutionary steady state. 
This steady-state strategy distribution is plotted as a function of number of 
neighbors K in Figure [5] We see that there exists an intermediate threshold 
for social connectivity (given by ~ 15) that allows for adequate information 
flow in the network to result in evolutionary branching. That is, social graphs 
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that are much sparser (fewer edges) than the ah-to-ah case analyzed in Section 
|4]can yield leader and follower evolutionary outcomes. 

In Figure [6] we present simulations similar to those described for Figure [5] 
above, for all three classes of social graph topologies (ring lattice, undirected 
random, directed random) and for N = 200, 400, 600. In each case, we see a 
minimum connectivity threshold for evolutionary branching that is higher than 
the minimum threshold for the social graph to be connected. We also see that 
this threshold for branching is not affected by increasing population size N in 
the range of N considered; i.e., the minimum fraction of the population that 
each node must be connected to for branching decreases with population size. 
Further, the location of the threshold is dependent on the class of graph being 
considered; the two classes of random graphs have lower thresholds than the 
ordered ring lattice. 



Ring Lattice 



Random Undirected 



Random Directed 




Number of Neighbor 



Mean Number of Neighbor; 




IVIean Number of Neighbc 




IVIean Number of Neighbor; 



IVIean Number of Neighbor; 




Number of Neighbor 




Mean Number of Neighbor 



Mean Number of Neighbor 



Figure 6: Evolutionary equilibria as a function of social graph topology for ring lattice, random 
undirected and random directed graph models with parameters /3 = 3 and c = 2.6; number 
of nodes N are shown on each plot. The minimum number of neighbors (or mean number for 
the random graphs) is independent of the number of nodes N in these plots, ~ 15 for the ring 
lattice, 9 for the random undirected graphs and ~ 8 for the random directed graphs. 



The simulations in this section illustrate the significant effect of limited social 
graph connectivity on the evolution of branching in migration. In particular 
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we show that social connectivity above threshold levels can yield two-strategy 
outcomes (leaders and followers) in the evolutionary dynamics. The thresholds 
depend on the classes of social graph topology being considered. Determining 
the analytical minimum connectivity threshold as a function of parameters /3, 
c and class of graph, is a topic of interest. A natural next step is to look 
at other classes of graph topologies such as spatially embedded graphs with a 
topological metric on connectivity (such as in [20]), and classes of small- world 
graphs parameterized by a single rewiring parameter [39l [SG] . The ring lattice 
and undirected random graphs considered here are two extreme limits of the 
Watts-Strogatz [39 small world connectivity model. 



6. Adaptive nodes 



Our analysis of the collective migration model (10) thus far has focused on 



the evolutionary perspective, considering the dynamics of networks with large 
numbers of nodes. As discussed in Sectionjl] the stochastic dynamics ( 10 ) can be 
interpreted more generally as collective tracking or learning dynamics in multi- 
agent systems of small or large size. In this section we shift focus and consider 
the model (10) from an adaptive perspective on small dynamic networks. This 



analysis is motivated in part by questions about leadership, task assignment, 
learning and robust adaptive behavior in multi-agent robotic systems. 

We consider a simple model of greedy local optimization by nodes on a graph, 
which yields individual adaptation of investments ki. For this model we show 
bifurcations as a function of cost that yield leader-follower emergent behavior as 
equilibria of the adaptive process. We also illustrate the critical role played by 
graph topology in determining the location of leaders in the network of adaptive 
nodes using several examples. 

Consider a system of interconnected agents with fast timescale tracking dy- 
namics given by (10). Further, suppose that each agent seeks to maximize its 
local utility function by adapting its investment parameter k^. We assume that 



the utility function for each agent Ui is given by the fitness function (11) 



Ui = exp 



exp {—ck'^ 



(32) 



In this setting, the utility function for a focal agent i depends on the agent's 
investment ki, as well as the investments of other nodes in the network; we 
assume that an agent can measure its own utility, but not the investments of 
other agents. Each agent modifies its investments ki on a slow timescale by 
climbing the gradient of its local utility Ui to reach its local maximum. 



• dki dUi . 



(33) 



Our goal is to study the outcomes of this adaptive process by computing equi- 



libria of the dynamics defined by (33), (32) and (10), and studying their bifur- 
cations. 
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6.1. N = 2 case 

We first look at the simplest case of the dynamics with N = 2 nodes, with 
an underlying all-to-all graph. In this case, the steady-state covariance matrix 
S (from ([2Q|)) can be computed analytically [26 as 

(Pet M)SS^ + [-M + (Tr M)] SS^ [-M + (Tr M)f 
~ -2(Det M)(Tr M) ' ^ ' 



where matrices M and S are defined in (10) and (13). For each pair {i^j} 



{1,2},{2,1}, the diagonal elements of S from (34) are given by 



2 ^ f^J {h - 1) " + (2fe| - 2k, + 1) ^ + f,,g,, 

where = (/c| - {h - 1) {k, - 1)^) , 
and Qij = (3A:| - 2k j + l) k'^ - 2kpi + 



Substituting (35) in (p3|) and (|32|), we compute the equilibria k^q of the 



dynamics (33) and (10) and their stability as a function of increasing cost 
parameter c. Analytical expressions of the equilibria are complicated; we il- 
lustrate the equilibria for /3 = 3 in Figure ^ For low cost, both individuals 
make a significant equal investment corresponding to the symmetric equilibrium 
keq,i = ^eg,2 ^ 0- As cost iucrcascs, the level of this equilibrium investment de- 
creases and eventually a pair of stable leader-follower equilibria appear via two 
saddle-node bifurcations. At this cost level, it is quite interesting to note that 
both the symmetric solution (monomorphic population) and the two-strategy 
solution (branching populations) coexist as stable solutions. However, as the 
cost increases further, the symmetric stable equilibrium loses stability in a sub- 
critical pitchfork bifurcation, leaving the leader-follower pair of stable equilibria 
and an unstable symmetric saddle equilibrium. A phase portrait for the slow 
timescale dynamics (strategies ki and /C2) is shown in Figure [t] for each of three 
values of cost c to illustrate the different sets of equilibrium solutions. 

6.2. N >2 all-to-all 



For larger networks with underlying all-to-all graph and dynamics (33) and 



(10), bifurcations in cost c yield generalizations of the bifurcations observed in 
the N = 2 case. Figure [S] illustrates these bifurcations in the case of N = 10. 
The plot on the left shows the equilibrium values of the strategies ki as a function 
of c. For a given value of c there are multiple co-existing stable leader-follower 
solutions, each solution differing by the number of leaders (and therefore the 
number of followers). For example, at c = 10 there are distinct stable solutions 
with 3, 4, 5 and 6 leaders; the adaptation of ki as a function of time is shown 
to the right at the bottom (marked by a triangle) for initial conditions that 
yields 4 leaders and 6 followers. Other examples are shown in the case c = 1 
and c = 3. It can be observed from Figure [S] that the fraction of nodes in the 
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Figure 7: Bifurcations for the adaptive node dynamics ( |33| with N = 2 nodes, an underlying 
all-to-all social graph, and noise parameter ^ = 3. The top plot shows the two components of 
keq (equilibria of the dynamics ( |33| and ( |10| ) as a function of the cost parameter c. Stable 
sinks are marked blue and unstable saddles are marked red. The inset shows a zoomed in view 
of the region with 15 < c < 20 marked in the dotted square. The dashed lines in the inset 
ci ~ 16.7 and C2 ~ 18.2 denote the saddle-node and pitchfork bifurcation points respectively. 
The row of bottom plots are phase portraits for the slow timescale dynamics with parameter 
c as indicated; the circles are stable sinks and the squares are saddles. These plots remain 
qualitatively the same for different values of /3 > 2; the bifurcation points ci and C2 move 
further to the right for higher /3. 



leader populations decreases with increasing cost parameter c as a consequence 
of several bifurcations in the dynamics. 

We note that although the underlying social graph is undirected and all-to- 
all, the adapted equilibrium solutions correspond to strongly directed graphs. 
In particular, the edges in the graph from leaders to their neighbors have small 
weights, whereas the edges from followers to their neighbors have large weights. 

6.3. Star topology and other topologies 

Above we show how the cost parameter c influences the number of leaders 
and followers that emerge from the adaptive dynamics in the case of an under- 
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Figure 8: Bifurcations for the adaptive node dynamics \33\ and with = 10 nodes, 

an underlying ah-to-all social graph, and noise parameter /3 = 3. The left plot shows stable 
equilibria of the dynamics as a function of c; plots of ki vs. time for the points marked with 
the circle (c = 1), square (c = 3) and triangle (c = 10) are shown on the right. The labels 
on the left plot indicate the number of leaders in each branch of stable solutions. It can be 
observed that bifurcations yield fewer leaders for increasing cost. 



lying all-to-all social graph. Here we study how the topology of limited social 
interconnections influences the emergence and location of leaders and followers. 
We illustrate this for a social graph defined by a star in Figure [9j the star graph 
has a significant asymmetry since the central node can sense all — 1 fringe 
nodes, whereas the fringe nodes can each only sense the central node. 

From the left plot in Figure |9j it can be seen that at low values of cost c, the 
fringe nodes of the star invest strongly in the external signal as leaders while 
the central node leverages these neighbors as a follower with small investment. 
In this case, the fringe nodes pay almost no attention to social cues from the 
central node while the central node relies almost exclusively on social cues from 
the fringe nodes (an exploding star graph). At intermediate cost c, as shown in 
the middle plot, all nodes make similar investments (monomorphic population). 
At high cost c, as shown in the right plot, the central node adapts to become 
the leader and ignores the fringe nodes, while all the fringe nodes leverage the 
central node's investment as followers (an imploding star graph). 

We show equilibrium outcomes for three more underlying social graph topolo- 
gies in Figure 10 For the undirected ring lattice shown on the left, and param- 
eter values indicated, alternate nodes adapt to become leaders (red) while the 
others become followers (blue). This is not surprising since an agent need not 
invest if both of its immediate neighbors are heavily invested. For more com- 
plicated topologies, the connection between topology and location of emergent 
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Figure 9: Role of topology and cost parameter c for the adaptive node dynamics ( |33| > and 
( |10| with N = 10, p = 3, and underlying social graph given by the star graph. In the star 
graph, the central node can sense all the fringe nodes but the fringe nodes can each only 
sense the central node. Each plot shows a simulation of the ten strategies ki versus time; 
the parameter c is indicated on each plot and can be seen to increase from left to right. The 
color-scale corresponds to the magnitude of equilibrium investment keq,i (higher values are 
hotter colors); these colors are superimposed on the picture of the star graph for each of the 
three simulations shown so that nodes with hotter colors can be observed to be the invested 
leaders. 



leaders is more challenging to interpret. Making the connection requires the de- 
velopment of a graph and investment dependent metric to rank nodes for their 
leadership potential, such as the information centrality metric used to rank cer- 
tainty of nodes in networks of stochastic evidence accumulators [M]. 




Figure 10: Role of topology in determining locations of leaders on the social graph. Parameters 
for all three plots are /3 = 3 and c = 4. The colors of nodes on each plot correspond to 
equilibrium investments ki for the dynamics ( |33| and ( |10| with magnitudes indicated in the 
color-bar. The left graph is an undirected star with = 10 nodes. The two right plots show a 
random spatial embedding of nodes with two different interconnection models. In the middle 
plot, each node is connected to its three nearest neighbors (topological distance) and in the 
right-most plot, each node is connected to all neighbors within a fixed radius given by the 
dashed line drawn (metric distance). 



7. Final remarks 

The study of leadership in dynamic networks has received significant at- 
tention in both biology and multi- agent robotics. In biology there has been 
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great interest in determining conditions for the stable evolution of leadership 
in systems of socially interacting agents where there is incentive for individuals 
to "free- ride" on the investment of others. In networked robotic systems, the 
leader-follower paradigm has been studied in a variety of contexts as a tool to 
design control protocols that achieve desired group performance. 

In this work, we derive an analytically tractable adaptive dynamic network 
model of collective migration in which investment (leadership) is costly and 
social interactions are cheap, and we use this model to study the role of the social 
interconnection graph in the evolution of leadership. We analyze bifurcations 
in the dynamics as a function of the cost of investment by leveraging a two- 
timescale dynamic with fast timescale migration dynamics and slow timescale 
adaptation of investments and social graph edge weights. In the all-to-all limit of 
the evolutionary model, our complete bifurcation analysis explains phenomena 
such as the observed hysteretic effect associated with recovery of migration 
in fragmented environments. In the general case of social interactions with 
limited connectivity, we prove necessary and sufficient conditions on the graph 
and investments such that the fitness of individuals in the stochastic migration 
model can be computed from a Lyapunov equation. We use this solution to 
show a minimum connectivity threshold in random and ordered networks above 
which there is evolutionary branching into leader and follower populations. 

Finally, we use our evolutionary collective migration model and fitness equa- 
tion to study smaller networks inspired by collective robotic systems; we replace 
the replication and mutation dynamics of the slow evolutionary timescale with 
dynamics in which agents adapt their individual investment and social interac- 
tion strategy according to a greedy optimization of their own utility function 
(fitness). We study bifurcations in these dynamics as a function of investment 
cost and show how the topology of the underlying network graph plays a crit- 
ical role in determining the emergence and location of leaders in the adaptive 
system. 

Further work is needed to derive rigorous minimum bounds on connectivity 
for branching of populations into leader and follower groups and generalization 
of our nonlinear dynamics analysis of adaptive networks using formal graph 
metrics. It is also of great interest to consider relaxing modeling assumptions 
and generalizing the form of the dynamics. Another important avenue for future 
work is to investigate where the top-down engineering design approach for group 
performance meets the bottom- up adaptive approach taken in this paper, i.e., 
to explain how group performance emerges from the adaptive network dynamic 
model and how we might leverage the bottom-up approach for design of high 
performing and resilient network dynamics in collective tasks. 
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Appendix A. Adaptive dynamics calculations 



In this section we discuss the details of the adaptive dynamics analysis from 
Section [42l Define the function 



G{kR,kM) 



kl^{l-kMrP\l-kR) 
4{2kl, - 2kM + 1) 



Then the differential fitness from ( |26[ ) is given by 

S = exp[-G{kR, /cm)] - exp[-G{kR, kR)]. 
The selection gradient g{kR) is given by 
dS 



dku 



= -exp[-G{kR,kR)]: 



kM{l-kM)[l^PHkR-l)] 
2{2kl, - 2kM + I? 



2ckM 



Solving for the singular strategy condition g{k^) = gives the expression (28) 

k^l - k,)[l + P\k, - 1)] + 4ck42kl - 2k, + 1)2 = 0. 

This expression has two sets of solutions that are plotted in Figure [3l One set 
corresponds to /c* = and the other is defined implicitly by the equation 



{k,-i)[i + /3Hh-i)] 



=: c{k,). 



4(2fc2 - 2k, + 1)2 
To determine conditions for evolutionary branching we compute 

- exp -ck^ + 

kM=kR=k^ 



(A.l) 



dkl^ 



Hence the branching condition ^rr 

o dki- 



(1 + /?2(-l + k,)) k, (3 - 10k, + Qkl) 
2{l-2k,+2klf 

> corresponds to 

6fc2^ 



kM—kR=k^ 

{P'^{l-k,)-l)k, (3-10fc« 



> 0. 



(A.2) 



2(l-2A:« + 2fc2)"^ 

The zeros of the function above in the range k, G [0, 1] are 0, and 1- 

A derivative test shows that the condition \A.2\ is satisfied for k, G ^0, • 
The critical cost parameter ci in Figure [3] corresponds to the maximum 
singular value k, for branching and is given from ( |A.1[ ) by ci = c { ^~^ ^ - The 
parameter C2 is determined by calculating the local maximum of the function 
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c{k^) as seen in Figure [s] We use the notation c{kcrit) = ^2- kcrit can be 
calculated analytically and is given by a particular root of a cubic equation. 
The analytical expression for kcrit (and correspondingly C2) is cumbersome and 
hence is left out of this text. Nonetheless, the sketch in Figure [3] clearly conveys 
the main ideas. 

Finally we discuss the convergence stability of the singular strategies. The 



convergence stability condition is given by (29). For the = singular strategy, 



dg 
dkn 



exp 



4 



- 1 - 4c , dg 

, hence — — 

2 dkn 



<0 



c > 



For the second singular strategy curve defined implicitly by ( A.l ), the deriva- 
tive term in the convergence stability condition evaluates to 



dg_ 
dkn 



k^ [-3 + lOk^ - Qkl - 2/32 (2kl - Qkl + - l)] e 
2(l-2/c* + 2fe2)3 



The interior root of ^— = is precisely the value kcrit that maximizes 

c{k^) (since c = c{k^) = g{k^) = 0); this root corresponds to C2 (see above). 
Hence one can verify that the singular strategies corresponding to the curve 

'^crit as shown in Figure [sj 



dA.ll) are stable for k^ > kcrit and unstable for k^ < k, 
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